Information theory, complexity and neural networks

Neural Networks and Complexity Theory

We survey some of the central results in the complexity theory of discrete neural networks, with pointers to the literature.

Information complexity of neural networks

This paper studies the question of lower bounds on the number of neurons and examples necessary to program a given task into feed forward neural networks. We introduce the notion of information complexity of a network to complement that of neural complexity. Neural complexity deals with lower bounds for neural resources (numbers of neurons) needed by a network to perform a given task within a g...

Complex Systems, Information Theory and Neural Networks

In this paper relation between complex systems, information theory and the simplest models of neural networks are elucidated. Two diierent types of complex systems are distinguished, new complexity measure based on the graph theory deened, hierarchy of the correlation matrices introduced and connection with the correlation matrix memories and other types of neural models explained. Complex syst...

Neural Networks, Information Theory and Knowledge Representation

information networks: theory, concepts and defintion

0